-
Bug
-
Resolution: Unresolved
-
Medium
-
None
-
None
-
None
-
3
-
9223372036854775807
Consider record & dump detail info while the watchdog was fired.
Dump info as below:
[22118.907148] Lustre: mdt_io00_000: service thread pid 173606 was inactive for 40.201 seconds. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes: [22118.907163] task:mdt_io00_000 state:D stack:0 pid:173606 ppid:2 flags:0x00000628 [22118.907171] Call trace: [22118.907172] __switch_to+0xc8/0x118 [22118.907183] __schedule+0x344/0xab8 [22118.907191] schedule+0x68/0x118 [22118.907194] schedule_timeout+0x1b8/0x300 [22118.907198] schedule_timeout_uninterruptible+0x30/0x40 [22118.907204] __cfs_fail_timeout_set+0x12c/0x1c8 [libcfs] [22118.907226] mdd_rename+0x284/0x19f8 [mdd] [22118.907248] mdt_reint_rename+0x39f8/0x4018 [mdt] [22118.907294] mdt_reint_rec+0x14c/0x2a8 [mdt] [22118.907323] mdt_reint_internal+0x584/0xd10 [mdt] [22118.907353] mdt_reint+0x7c/0x138 [mdt] [22118.907382] tgt_handle_request0+0x154/0x7e8 [ptlrpc] [22118.907491] tgt_request_handle+0x7b8/0x14e0 [ptlrpc] [22118.907584] ptlrpc_server_handle_request+0x2d4/0xc60 [ptlrpc] [22118.907680] ptlrpc_main+0xb6c/0x1608 [ptlrpc] [22118.907754] kthread+0x150/0x160 [22118.907759] ret_from_fork+0x10/0x18 [22118.907772] Lustre: 86225:0:(service.c:2907:dump_svc_thread_info()) @@@ lustre-MDT0000: Thread mdt_io00_000:173606 is handling req@ffff0000928756c0 x1875423193540352/t0(0) o36->76a3a3bc-94cd-4ca6-aed8-b01e117eb5f9@0@lo:0/0 lens 504/2888 e 0 to 0 dl 1788543179 ref 1 fl Interpret:/200/0 rc 0/0 job:'mv.0' uid:0 gid:0 projid:4294967295 [22118.907780] Lustre: 86225:0:(service.c:2920:dump_svc_thread_info()) ======Thread mdt_io00_000:173606 PRA dump START========= [22118.907790] Lustre: 86225:0:(mdt_io00_000:173606:00()) LOCK ns: mdt-lustre-MDT0000_UUID lock: ffff0000514f0000/0x46d373f08aca7702 lrc: 2/0,1 mode: CW/CW res: [0x20003e431:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 173606 initiator: MDT0 lru_score: 0 lru_type: 0 [22118.907798] Lustre: 86225:0:(mdt_io00_000:173606:01()) LOCK ns: mdt-lustre-MDT0000_UUID lock: ffff0000514f1600/0x46d373f08aca7709 lrc: 2/0,1 mode: PW/PW res: [0x20003e431:0x4:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 173606 initiator: MDT0 lru_score: 0 lru_type: 0 [22118.907805] Lustre: 86225:0:(mdt_io00_000:173606:02()) LOCK ns: mdt-lustre-MDT0000_UUID lock: ffff0000514f0200/0x46d373f08aca7710 lrc: 2/0,1 mode: PW/PW res: [0x20003e431:0x4:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 173606 initiator: MDT0 lru_score: 0 lru_type: 0 [22118.907812] Lustre: 86225:0:(mdt_io00_000:173606:03()) LOCK ns: mdt-lustre-MDT0000_UUID lock: ffff0000514f0600/0x46d373f08aca7717 lrc: 2/0,1 mode: EX/EX res: [0x20003e431:0x7:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 173606 initiator: MDT0 lru_score: 0 lru_type: 0 [22118.907817] Lustre: 86225:0:(service.c:2933:dump_svc_thread_info()) ======Thread mdt_io00_000:173606 PRA dump END===========