Details
-
Bug
-
Resolution: Fixed
-
Major
-
Lustre 2.4.0
-
None
-
3
-
6150
Description
This issue was created by maloo for wangdi <di.wang@intel.com>
This issue relates to the following test suite run: https://maloo.whamcloud.com/test_sets/7179c526-600d-11e2-84d4-52540035b04c.
The sub-test test_40 failed with the following error:
test_40 failed with 4
Info required for matching: replay-single 40
I met this during DNE test, but DNE does not touch this part of code at all. I just investigate the debug log
a bit, it seems the failure is related with recent layout lock landing. Jinshan, Could you please have a look?
00000100:00100000:0.0:1358254377.783158:0:23931:0:(client.c:2059:ptlrpc_set_wait()) set ffff88006c48ae00 going to sleep for 0 seconds
00000100:00100000:0.0:1358254378.202028:0:23930:0:(client.c:2059:ptlrpc_set_wait()) set ffff88006c48a980 going to sleep for 0 seconds
00000100:00100000:0.0:1358254378.783171:0:23931:0:(client.c:2059:ptlrpc_set_wait()) set ffff88006c48ae00 going to sleep for 0 seconds
00000100:00100000:0.0:1358254379.202097:0:23930:0:(client.c:2059:ptlrpc_set_wait()) set ffff88006c48a980 going to sleep for 0 seconds
00000100:00100000:0.0:1358254379.217287:0:23931:0:(client.c:1957:ptlrpc_interrupted_set()) INTERRUPTED SET ffff88006c48ae00
00000100:00100000:0.0:1358254379.217291:0:23931:0:(client.c:2059:ptlrpc_set_wait()) set ffff88006c48ae00 going to sleep for 0 seconds
00000100:00100000:0.0:1358254379.217298:0:23931:0:(client.c:1774:ptlrpc_check_set()) Completed RPC pname:cluuid:pid:xid:nid:opc writeme:ba5d0671-fa8b-7c21-6711-f632712f4bd4:23931:1424228991737390:10.10.4.211@tcp:101
00010000:00010000:0.0:1358254379.217308:0:23931:0:(ldlm_request.c:547:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff88006ccbac00 lock: ffff88006bea0200/0xb20e505c2e7d4ca0 lrc: 4/1,0 mode: --/CR res: 8589959616/1603 bits 0x8 rrc: 1 type: IBT flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23931 timeout: 0 lvb_type: 3
00010000:00010000:0.0:1358254379.217315:0:23931:0:(ldlm_request.c:496:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff88006ccbac00 lock: ffff88006bea0200/0xb20e505c2e7d4ca0 lrc: 4/1,0 mode: --/CR res: 8589959616/1603 bits 0x8 rrc: 1 type: IBT flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 23931 timeout: 0 lvb_type: 3
00010000:00010000:0.0:1358254379.217320:0:23931:0:(ldlm_lock.c:849:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff88006ccbac00 lock: ffff88006bea0200/0xb20e505c2e7d4ca0 lrc: 4/1,0 mode: --/CR res: 8589959616/1603 bits 0x8 rrc: 1 type: IBT flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 23931 timeout: 0 lvb_type: 3
00010000:00010000:0.0:1358254379.217326:0:23931:0:(ldlm_lock.c:914:ldlm_lock_decref_internal()) ### final decref done on cbpending lock ns: lustre-MDT0000-mdc-ffff88006ccbac00 lock: ffff88006bea0200/0xb20e505c2e7d4ca0 lrc: 3/0,0 mode: --/CR res: 8589959616/1603 bits 0x8 rrc: 1 type: IBT flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 23931 timeout: 0 lvb_type: 3
00010000:00010000:0.0:1358254379.217332:0:23931:0:(ldlm_lockd.c:1667:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff88006ccbac00 lock: ffff88006bea0200/0xb20e505c2e7d4ca0 lrc: 4/0,0 mode: --/CR res: 8589959616/1603 bits 0x8 rrc: 1 type: IBT flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 23931 timeout: 0 lvb_type: 3
00010000:00010000:0.0:1358254379.217336:0:23931:0:(ldlm_lockd.c:1680:ldlm_handle_bl_callback()) Lock ffff88006bea0200 already unused, calling callback (ffffffffa09c8f90)
00010000:00010000:0.0:1358254379.217339:0:23931:0:(ldlm_request.c:1095:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff88006ccbac00 lock: ffff88006bea0200/0xb20e505c2e7d4ca0 lrc: 5/0,0 mode: --/CR res: 8589959616/1603 bits 0x8 rrc: 1 type: IBT flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 23931 timeout: 0 lvb_type: 3
00010000:00010000:0.0:1358254379.217361:0:23931:0:(ldlm_request.c:1108:ldlm_cli_cancel_local()) not sending request (at caller's instruction)
00010000:00010000:0.0:1358254379.217364:0:23931:0:(ldlm_lockd.c:1689:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff88006ccbac00 lock: ffff88006bea0200/0xb20e505c2e7d4ca0 lrc: 3/0,0 mode: --/CR res: 8589959616/1603 bits 0x8 rrc: 1 type: IBT flags: 0xa0f400000000 nid: local remote: 0x0 expref: -99 pid: 23931 timeout: 0 lvb_type: 3
00010000:00010000:0.0:1358254379.217369:0:23931:0:(ldlm_lock.c:219:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff88006ccbac00 lock: ffff88006bea0200/0xb20e505c2e7d4ca0 lrc: 0/0,0 mode: --/CR res: 8589959616/1603 bits 0x8 rrc: 1 type: IBT flags: 0xa0f400000000 nid: local remote: 0x0 expref: -99 pid: 23931 timeout: 0 lvb_type: 3
00000002:00020000:0.0:1358254379.217379:0:23931:0:(mdc_locks.c:830:mdc_enqueue()) ldlm_cli_enqueue: -4
00000080:00200000:0.0:1358254379.218420:0:23931:0:(vvp_io.c:95:vvp_io_fini()) ignore/verify layout 0/0, layout version -1.
00000080:00200000:0.0:1358254379.218486:0:23931:0:(file.c:306:ll_file_release()) VFS Op:inode=144115607908910659/33554529(ffff88006cbf8238)
00000002:00080000:0.0:1358254379.218516:0:23931:0:(mdc_request.c:836:mdc_close()) @@@ matched open req@ffff88006c57d000 x1424228991737309/t171798692241(171798692241) o101->lustre-MDT0000-mdc-ffff88006ccbac00@10.10.4.211@tcp:12/10 lens 576/544 e 0 to 0 dl 1358254380 ref 1 fl Complete:RP/4/0 rc 0/301